Cohesion Grading Decisions in a Summary Evaluation Environment: A Machine Learning Approach
نویسندگان
چکیده
The work presented in this paper has been carried out in the context of a summary writing environment provided with automatic grading. Regarding summarisation discourse, some of the most relevant variables identified in previous work are comprehension, adequacy, use of language, coherence, and cohesion. This work is focused on cohesion. The described exploratory study starts from basic automatic measures of cohesion to further analyse which of them best reflects human expert overall cohesion grades for learner summaries written in the Basque language. For this purpose, 45 basic cohesion measures are compared to overall human cohesion grades. Machine Learning techniques are used to select the best combination for cohesion grading.
منابع مشابه
Automatically Grading the Use of Language in Learner Summaries
A summary is a short clear description that gives the main facts or ideas about something. Summaries are widely used in traditional teaching as an educational diagnostic strategy to infer comprehension, or how much information from text is retained in memory. From its early beginning Computer Supported Learning Systems research has faced open-ended learners’ response evaluation. Global summary ...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملLexTrim: A Lexical Cohesion Based Approach to Parse-and-Trim Style Headline Generation
In this paper we compare two parse-and-trim style headline generation systems. The Topiary system uses a statistical learning approach to finding topic labels for headlines, while our approach, the LexTrim system, identifies key summary words by analysing the lexical cohesion structure of a text. The performance of these systems is evaluated using the ROUGE evaluation suite on the DUC 2004 news...
متن کاملA Particle Swarm Optimization Approach to Joint Location and Scheduling Decisions in A Flexible Job Shop Environment
In traditional scheduling literature, it is generally assumed that the location of facilities are predetermined and fixed in advance. However, these decisions are interrelated and may impact each other significantly. Therefore finding a schedule and facility location has become an important problem as an extension of the well-known scheduling problems. In this research we consider joint decisio...
متن کامل